This topic is about using Allas and storing data.
All materials (c) 2020-2023 by CSC – IT Center for Science Ltd. This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 Unported License, http://creativecommons.org/licenses/by-sa/4.0/
/scratch and /projappl disks)s3cmd, rclone, a-tools)swift, rclone, a-tools, cyberduck)rclone, swift, s3cmd, a-toolsrclone or a-toolsrcloneswift-protocol, but S3 can also be usedrclone instructions at Docs CSCa-toolsrclone-based scripts for using Allas in Puhti and Mahtia-tools provide an easy and safe way to use Allas for occasional Allas usersrclone, a-tools does not overwrite or remove data without asking!a-put/a-get: pros and cons➕ Saving data as a tar package preserves time stamps, access settings, and internal links of the directory
➕ Optional zstdmt compression reduces size
➕ The default bucket name and the metadata reflect the directory structure on Puhti/Mahti
➕ Checks to prevent overwriting data accidentally
➖ Usage of objects created by a-put can be complicated when other object storage tools are used
➖ Usage from Windows is problematic
➖ Each object has an additional _ameta object
swiftswift)